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Abstract 


Flight research experiments have demonstrated that adaptive flight controls can be an effective 
technology for improving aircraft safety in the event of failures or damage. However, the nonlinear, time- 
varying nature of adaptive algorithms continues to challenge traditional methods for the verification and 
validation testing of safety-critical flight control systems. Increasingly complex adaptive control theories 
and designs are emerging, but only make testing challenges more difficult. A potential first step toward 
the acceptance of adaptive flight controllers by aircraft manufacturers, operators, and certification 
authorities is a very simple design that operates as an augmentation to a non-adaptive baseline controller. 
Three such controllers were developed as part of a National Aeronautics and Space Administration flight 
research experiment to determine the appropriate level of complexity required to restore acceptable 
handling qualities to an aircraft that has suffered failures or damage. The controllers consist of the same 
basic design, but incoiporate incrementally- increasing levels of complexity. Derivations of the controllers 
and their adaptive parameter update laws are presented along with details of the controllers’ 
implementations. 


Nomenclature 


Acronyms 


FAST 

IFCS 

IRAC 

MRAC 

NASA 

NDI 

OCM 

onMRAC 


full-scale advanced systems testbed 

intelligent flight control system 

intelligent resilient aircraft control 

model reference adaptive control 

National Aeronautics and Space Administration 

nonlinear dynamic inversion 

optimal control modification 

MRAC with normalization and OCM 


onMRAC+ MRAC with normalization, OCM and additional adaptive parameters 
RFI request for information 

SDC self designing controller 

sMRAC simple MRAC 


Mathematical Symbols 

A matrix of state derivative coefficients 

B matrix of input coefficients 

C output error feedback compensator 

f A applied aerodynamic and inertial moments 

f A estimate of applied aerodynamic and inertial moments 

H angular momentum vector 

1 inertia matrix 

k reference model forward path gain 

k uncertain forward path gain 

L a reference model apparent lift curve slope 

L a uncertain apparent lift curve slope 

m number of control effectors 

M vector of applied moments 

N control weighting matrix 
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p roll rate 

p q individual element of the matrix solution to the pitch axis Lyapunov equation 

p roll rate tracking error 

p roll acceleration 

p roll acceleration tracking error 

P solution to the Lyapunov equation 

q pitch rate 

q q individual element of the pitch axis Lyapunov equation matrix 

q pitch rate tracking error 

q pitch acceleration 

q pitch acceleration error 

Q right-hand-side term of the Lyapunov equation 

r reference model input 

r max maximum achievable yaw rate 

f uncertain reference input 

f yaw acceleration 

R reference model 

s Laplace operator 

t time 

u scalar control input 

V Lyapunov function 

V Lyapunov function derivative 

x state vector 

x state derivative vector 

x state error vector 

x derivative of the state error vector 

y output vector 

a angle of attack 

y adaptive parameter learning rate 

T matrix of adaptive parameter learning rates 

8 surface command vector 

8 ap pilot roll stick input 

8 ep pilot pitch stick input 

A moments due to external disturbances 

( reference model damping ratio 

<f uncertain damping ratio 

9 matched uncertainty parameter 

9 matched uncertainty parameter adaptive estimate 

9 matched adaptive parameter estimate error 

0 vector of matched uncertainty parameters 

0 vector of matched uncertainty parameter derivatives 

0 vector of matched uncertainty parameter derivative estimates 

0 vector of matched uncertainty parameter estimate errors 

0 vector of matched uncertainty parameter estimate error derivatives 

ji forward path gain uncertainty 

p L apparent lift curve slope uncertainty 

v optimal control modification tuning gain 

a scalar time- varying uncertain disturbance 
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d 

a 

a 

a 

0) 

c5 

0 

fl 

Subscripts 

0 

a 

c 

cmd 

err 

m 

V 

q 

ref 

S 

9 

a 

Superscript 

n 


scalar time- varying uncertain disturbance adaptive estimate 

scalar time- varying uncertain disturbance adaptive estimate derivative 

scalar time- varying uncertain disturbance adaptive estimate error 

scalar time-varying uncertain disturbance adaptive estimate error derivative 

reference model undamped natural frequency 

uncertain undamped natural frequency 

vector of body-axis rotational rates 

vector of body-axis rotational accelerations 


trim 

adaptive augmentation 
compensator augmentation 
command 

NDI reference model tracking error 
MRAC reference model 
roll axis 
pitch axis 

NDI reference model 
surface commands 
matched uncertainties 
uncertain disturbance 


number of reference model states 


Introduction 

Flight research of adaptive control algorithms has been sporadic over the past 50 years, providing 
relatively little flight data to guide present-day designers on their application to full-scale piloted aircraft. 
Examples that do exist include the first flight tests of a model reference adaptive controller on the F-94A 
aircraft (Lockheed Martin, Bethesda, Maryland) (ref 1), an experimental adaptive flight control system 
evaluated on the F-94C aircraft (Lockheed Martin, Bethesda, Maryland) (ref. 2), the implementation of an 
adaptive flight control system on the X-15 aircraft (North American Aviation Inc., Downy, California) 
(refs. 3, 4), testing of an indirect-adaptive self designing controller (SDC) on the F-16 VISTA (General 
Dynamics, now Lockheed Martin, Bethesda, Maryland) (ref. 5) and the intelligent flight control system 
(IFCS) research on the highly-modified National Aeronautics and Space Administration (NASA) F-15 
aircraft (McDonnell Douglas, now The Boeing Company, Chicago, Illinois) (refs. 6, 7) . By the mid- 
2000s, experiments such as SDC and IFCS had demonstrated that adaptive flight controls can be an 
effective technology for improving aircraft safety in the event of failures or damage. However, the 
nonlinear, time-varying nature of adaptive systems continues to challenge traditional methods for the 
verification and validation of safety- critical flight control systems. 

In April of 2009, NASA’s Integrated Resilient Aircraft Control (IRAC) project disseminated a 
request for information (RFI) to the adaptive controls community seeking ideas for potential flight 
experiments (ref. 8). A workshop was held in Chicago in August of 2009 with representatives from 
industry, academia and other government agencies to discuss the wide variety of RFI responses received 
by NASA. Three focus areas were identified through this process. 
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1. Simple, yet effective, adaptive control algorithms should be investigated to help address the issue 
of verification and validation of adaptive flight controls to a safety-critical level. 

2. The appropriate level of pilot awareness and interaction with adaptive control systems should be 
studied, including the potential for adverse interactions such as pilot-in-the-loop oscillations. 

3. Techniques should be matured for incorporating feedback information, both static and dynamic, 
from an aircraft’s structure into the flight control system. 

The first, and to some extent, the second of these focus areas prompted the application of a low 
complexity, textbook-like direct model reference adaptive control (MRAC) scheme to the NASA Full- 
Scale Advanced Systems Testbed (FAST). FAST is a highly modified F-18 aircraft (McDonnell-Douglas, 
now The Boeing Company, Chicago, Illinois) that contains a research flight control system capable of 
housing advanced flight controls experiments. Full-scale piloted in-flight experimentation of adaptive 
systems has been shown to uncover implementation issues that may not be found through experiments 
with simulations or sub-scale, remotely piloted aircraft (refs 1, 4-7). Three variations of a low complexity 
MRAC design were evaluated for a healthy airplane and five simulated failure scenarios, characterized by 
a severe loss of damping in either the pitch or the roll axis, a loss of static pitch stability, a failed 
stabilator, and coupling from the roll axis into the pitch axis. 

A philosophy of “simpler is better” motivated the development of the low complexity MRAC 
formulation under the assumption that simplification leads to lower implementation and verification costs, 
and ultimately to a greater likelihood of acceptance by aircraft manufacturers, operators and certification 
authorities. Reduced complexity can also lead to a safer design by reducing the potential for 
implementation errors within the adaptive controller software. 

Evaluation of the relative complexity of various control techniques, including adaptive control 
methods, requires metrics for measuring complexity as it relates to design, implementation, software 
qualification, and flight testing. Various levels of reduced complexity were achieved for the three 
adaptive controllers through the incremental minimization of the following categories of elements 
common to most flight control systems. 

1. Mathematical constructs such as integrators and filters require initialization or internal state 
limiting, and so their implementation requires special attention during design and testing. Other 
examples include inverse functions which must be protected from divide-by-zero scenarios. 

2. Free design parameters such as gains, learning rates, and filter coefficients are elements of the 
controller that must be tuned to achieve the desired combination of controller performance and 
robustness. Increasing the number of free design parameters tends to complicate the design and 
verification effort of the controller due to the potential for unforeseen interactions and the 
increased difficulty of intuitively identifying cause and effect. 

3. Input / output plane dimensionality of the adaptive controller impacts control system analysis and 
testing. Robustness analysis is typically performed at each feedback loop and each output. Noise, 
latency, and sampling rate characteristics must be evaluated and analyzed for each input and 
actuator dynamics included for each output. During development and testing, the failure mode of 
each input and output must be characterized, and their effects considered. 

Three variations of a model reference adaptive control design were implemented as pilot-selectable 
augmentation modes to a non-adaptive baseline, nonlinear dynamic inversion (NDI) controller. This 
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approach is representative of a pilot-initiated emergency mode. Figure 1 shows the top-level block 
diagram of the integrated NDI and MRAC controllers. The simplest design consisted of a single adaptive 
parameter in each of the pitch and roll axes, computed using a basic gradient-based update law. A second 
design increased the complexity of the update law, while the third included one additional adaptive 
parameter in each axis. 



Figure 1. MRAC with NDI block diagram. 


Nonlinear Dynamic Inversion Controller Description 

The non-adaptive baseline is a full, nonlinear dynamic inversion inner-loop controller. The NDI 
inner-loop includes a proportional-plus-integral output error feedback compensator for improved 
robustness. NDI was chosen for its analyzability and open-source architecture. Furthermore, its explicit 
model-following architecture and on-board aerodynamic lookup tables provide convenient methods for 
introducing simulated aircraft failures and damage. 

NDI inverts the aircraft equations of motion to compute appropriate control surface commands. The 
rotational equations of motion for an aircraft can be written using the relationship between the rate of 
change of momentum and applied moments under the assumption of constant inertias (ref. 9): 

^H(t) = m(t) + n (t) X /O(t) = £M(t) (1) 

Equation (1) is solved for the rotational acceleration vector /fl(t) as a function of the inertial 
coupling terms f!(t) X /f!(t) and the applied moments £M(t). The applied moments term is expanded 
into the applied aerodynamic and inertial moments f A , the applied moments due to control surface 
deflections — 5 0 ), and applied moments due to disturbances A(t). 
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It m = f A (y(t)) + B s m ) - So) - nco X m(t ) - a ( t) 


( 2 ) 


Here, y(t) is the output vector consisting of rotational body rates and the aerodynamic angles of 
attack and sideslip. The rotational acceleration vector fl(t) on the left-hand side is replaced by the vector 
of desired rotational acceleration commands x cmd (t). The aerodynamic and inertial moments are 
replaced with an estimate ^(y(t)) computed from on-board aerodynamic lookup tables. Equation (2) is 
then solved for the control surface deflection vector <5(t) necessary to achieve the commanded dynamics. 
When computing the commands, the disturbance term A(t) is assumed to be zero because it is generally 
not known. 


m = Bs 1 (ix cmd et) + net) x me o - f A (yet)j) + a 0 (3) 

Uncertainty in aerodynamic lookup tables or the presence of a non-zero disturbance A(t) will produce 
errors in the inverted dynamics of equation (3). A proportional-plus-integral output error feedback 
compensator C is added to reduce the inversion errors and improve model following. Similarly, adaptive 
feedback compensation can be added to account for larger errors due to failures or damage. Equation (4) 
gives the expanded acceleration command vector for each axis. Note that in equation (4) the x re ^(t) 
terms are the outputs of the reference model in figure 1, the x c (t) terms are the outputs of the error 
compensator C, and the x a (t) terms are the adaptive control contributions. Additional details on the NDI 
implementation can be found in Miller (ref. 10). 


'''CimiW X re j- (t ) + X c (t) + X a (t) 


Pr-eftt) + Pc(t) + Patt) 
Rrefit) + q c (t) + q a (t) 
Xref (0 + f c (t) 


( 4 ) 


The NDI controls all three axes, although adaptive augmentation is applied only to the pitch and roll 
axes of the aircraft, as the characteristics of these axes tend to dominate the pilot’s perception of handling 
qualities for the proposed set of flight maneuvers. The relative benefits of incoiporating yaw-axis 
adaptation were extensively debated by the design team. Ultimately, in keeping with the philosophy of 
simplification, yaw-axis adaptation was not included so that related performance deficiencies, if any, 
might be definitively revealed through flight test, at least for the proposed set of simulated failures and 
aircraft maneuvers. 


General Description of the Low Complexity Model Reference Adaptive 
Controller 

Model reference adaptive control (MRAC) derives its name from the use of reference model 
dynamics to define a desired trajectory for the system outputs to follow (ref. 11). The reference model for 
the aircraft axis of interest is specified as a stable, linear time-invariant system: 

x m eO = A m x m (t) + S m r(t) (5) 

The scalar reference input r(t) in equation (5) is a function of the time-varying pilot control 
command. Constant matrices A m E R nxn and B m E R nxl are selected to give good aircraft handling 
qualities. The aircraft’s true dynamics, which are uncertain and possibly unstable, may be written as 

x(t) = Ax(t) + B(u(t) — n(t)) (6) 
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where A and B are u nk nown and cr(t) is a scalar, time-varying uncertain disturbance. The u nk nown 
aircraft dynamics and known reference model dynamics are related according to the MRAC matching 
conditions (ref. 11): 


A = A m - B@ t 


B 


= B n 


(7) 

( 8 ) 


Several restrictions are apparent from the matching conditions in equations (7) and (8). The order n of 
the reference model must match the order of the aircraft dynamics described by equation (6), which also 
defines the number of matched uncertainties in the parameter vector 0. These uncertainties, commonly 
referred to as A-matrix uncertainties, are additive and parameterize changes to the aircraft’s pitch and roll 
dynamics. It is assumed that these uncertainties are either constant or that they vary slowly in comparison 
to the aircraft’s dynamics. The 5-matrices are assumed to be identical so that any differences in control 
effectiveness are parameterized as exogenous disturbances, as discussed below. 


Parameterization of Pitch Axis Uncertainty 

The typical representation of an aircraft’s pitch-axis short-period dynamics is as a second-order 
transfer function (ref. 12). Let equation (9) represent the desired dynamics defined by the reference 
model, while the uncertain pitch dynamics (without external disturbances) are given by equation (10). 


q m00 

kqt’Jq 0> + 

(9) 

S e p(s) 

S 2 + 2 ^qOJ q S + COg 


q 00 

kq(*)q 0> T 

(10) 

5 ep 00 

S 2 + 2 ^qCOqS + CO q 



Equations (9) and (10) can be written in the state space form of equations (5) and (6), with the 
introduction of an u nk nown external disturbance A q in the aircraft’s true dynamics. 


Rm (0 

4m (0- 




( 8 ep (t ) + L a f <5 ep (0) 


4(0' 

4(0- 


0 1 
—COq — 2 ZqCO q 



( 11 ) 


( 12 ) 


The MRAC matching condition in equation (7) can now be used to parameterize the pitch axis 
matched uncertainty using the A-matrices from equations (11) and (12), where B = B q = [0 l] T and 
Q T = Q q = | Qq\ 0 q2 1. Equation (13) shows that the uncertainty term 6 ql corresponds to uncertainty in 
the short period natural frequency and that 0 q2 represents uncertainty in both the short period frequency 
and damping. 


0 1 


0 1 

—CO q —2( q O) q 


~( 0) q + 6ql) + ^ 2 ). 


(13) 


Define the reference input signal for the reference model according to equation (14) and for the 
uncertain pitch dynamics by equation (15). 
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( 14 ) 


r q {t) = k q co% (<5 'ep(t) + L a J ffep(t)) 
r q (t) = k q C 0 q (<5 ep (t) + L a J S ep (t)) (15) 


The total input uncertainty is parameterized by writing the entire input expression (t) — (t) of 

equation (12) in terms of the known reference input r q (t) and the uncertainty parameter o q (t) : 


r q (t) - A q (t) = r q (t) - o q (t) 


(16) 


Insight into a q (t) can be found by re-arranging equation (16) and writing it in terms of the known 
components of equation (14) and uncertainty parameters for feed-forward gain uncertainty f. i q , the 
apparent lift curve slope uncertainty ji L and external disturbances A q (t). 


<j q (t) k q co q [ 1 


kq] 


1 la ] 

<5 e p(t)' 

.1 la — Ml. 

J s ep {t) 


+ A q (t) 


(17) 


The feed-forward gain and apparent lift curve slope uncertainty parameters are defined in equations 
(18) and (19), respectively. It will be shown that the adaptive controller does not estimate each of these 
uncertainties independently, but rather computes the aggregate estimate d q (t). 

_ kq(*)q 

N ~k^ q (18) 

Ml = (£«“£«) (19) 


Parameterization of Roll Axis Uncertainty 

A first-order transfer function is used to model the stability axis roll dynamics (ref. 10). Let equation 
(20) represent the known desired dynamics and equation (21) represent the u nk nown roll axis dynamics 
(again without external disturbances). 


p m (s) fr)Vy 

^apOO $ T COp (20) 

p(s) 

^apOO $ "h CO p (21) 


Following the approach used in the pitch axis, equations (20) and (21) are written in state space 
notation, with the introduction of the external disturbance term A p (t). 

Pm(0 = [-<Up]Pm(0 + [1] (~^y) fc p"p 5 ap(0 (22) 

p(t) = [-ft) p]p(t) + [1] ^pd)p<5 a p(t) - Ap(t) j 
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(23) 



The MRAC matching condition of equation (7) is used to parameterize the roll axis uncertainty, 
where B = B p = [1] and 0 = 0 p = 9 p . 


-a) p - -(u) p + 6-p) (24) 

Define the reference input signal for the reference model according to equation (25) and for the 
uncertain roll dynamics according to equation (26). 

r p(0 = (25) 

= (([(£)) (26) 

The total input uncertainty is parameterized by writing the entire input expression f p (t) — A p (t) of 
equation (23) in terms of the known reference input r p (t) and the uncertainty parameter er p (t): 

f p (0 - A p (t) = r p (t) - o p (t) (27) 


The uncertainty term a p contains the term p p , which is a parameterization of uncertainty in the gain 
between the known and u nk nown reference input signals of equations (25) and (26), as well as the 
external roll disturbance A p (t). 

Op (0 = (~^y) ~ Bp)8 ap (.t) + A p (t) (28) 

The roll feed forward gain uncertainty is defined as 

kp u)p 

~~ k^p (29) 

Adaptive Control Commands 

The scalar control input u(t) in equation (6) for the pitch axis is defined to be a combination of the 
scalar reference input and augmentation from the adaptive controller. 


u q it) = r q (t) + q a (t) = r q (t) + [6 ql (t) 


^(O] 


J <7 (O' 
<7(0- 


+ o q (t) 


(30) 


Adaptive parameters 8 ql (t), 0 q2 (t) and d q (t) are estimates of the 9 ql , 0 q2 and a q uncertainties. The 
control input from equation (30) is substituted into the pitch axis form of equation (6) along with the 
matching condition of equation (13) to find 


<7 (O' 


0 

1 

J q{ 0 

-4(0 


— {j^q “k 9 q i) 

— (2£ ) q(i)q + d q2 ') 

<7(0- 


+ 



^j(0 + P,i(t) 


^72 ( 0 ] 


J q(ty 

<7(0- 


+ d a (t) - aJt) 


(31) 
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Re-arrange to combine similar terms. 


q(t) 


Ait). 



-o>: 


( 


0 

@ql ~ 


+ 


2 Sqdlq - ( 

Gl { T qW ~ { ff qW ~ d qW)) 


®q2 ^q2(0) 


J <?(t) 

q(t) 


( 32 ) 


The control objective is that as adaptation takes place, 9 ql {t) -* 9 ql , 9 q2 (t) -* d q2 and <r(t) -» er(t) 
so that the dynamics of equation (33) approach the desired reference dynamics of equation (1 1). 


q(ty 


Ait). 



0 

-(On 


1 1 [ D ®1 + [ 0 1 

2 ( q (o q \ [ q(t)J 1-lJ 


r q {t) 


(33) 


The roll axis scalar control input u p (t) contains the reference input and two adaptive parameters. 

u p (t) = r p (t) + p fl (t) = r p (t) + 0 p (t)p(t) + CTp(t) (34) 

Under the control signal of equation (34) the roll axis dynamics can be written as 


p(t) = - (d p - 0p(t))] p(t) + [1] (r p (t ) - (c7p(t) - ff p (t))) 


(35) 


Similar to the pitch axis, as 9 p -* 9 p and d p -> cr p the airplane roll axis dynamics match the desired 
reference model dynamics in equation (22). 


Pit) = [-m p ]p(t) + [l]r p (t) (36) 

Basic Adaptive Parameter Update Laws 

The three adaptive control designs all employ variations of the same basic adaptive parameter update 
laws, developed in this section. 


Pitch Axis MRAC 

Pitch axis tracking error is computed by subtracting the aircraft response from the desired dynamics 
of the reference model. 


7 qit)' 


I qmit) 


7 qit) 

- qit). 


Rmit)- 


- qit). 


(37) 


Differentiate equation (37) and substitute equations (11), (14) and (32), making the following 
definitions: 6 ql (t) = 6 ql - 6 ql (t), § q2 (t ) = 9 q2 - § q2 (t ) and a q (t) = a q (t) - a q (t ). 
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( 38 ) 


q(.ty 

4 ( 0 - 



1 1 \fq m (.ty 

~^q M q\ [ q m (t). 

r 0 


+ 



-<*l - OqltO -2Sq<Oq ~ fyzCO 




Equation (38) can be re-arranged to form the following expression for the pitch axis error dynamics. 

%q(t) = A mq x q (t ) + B mq ®\{t)x q {t) + B mq a q (t ) (39) 

Define the following Lyapunov function according to equation (40), where P q = P q 6 M 2x2 and is 
positive definite. Note also that the positive definite matrix Y g 6 M 2x2 and that y 0q E M + . The matrices 
Ig and P q are defined in equations (41) and (42) respectively. 


V q (t) = x T q {t)P q x q {t) + + 



Ye ql 

0 

0 

Ye q2 

Pq 1 

pI 2 ' 

V X q 

Pq 2 . 


Differentiate equation (40). 


V q (t) = k T q ( t)P q xJt ) + xUt)P q L(t ) + 2®Jt)r e '®Jt) + 


2ffq(t)jfg(t) 

Yc n 


(40) 

(41) 

(42) 


(43) 


Substitute x q (t) and x q (t) from equation (39) to get equation (44). 


Vq( 0 = XqiOA^PqXqit) + X^(t)® q (t)B^ q P q X q (t) + a q (t)B^ q P q X q (t) 

+ x T q {t)P q A mq x q (t) + xl(t)P q B mq ® T q (t)x q (t ) + x T q {t)P q B mq o q {t ) 


+ 2 0 T q (t)r gq 1 & q (t) + 


2d q (t)d q (t) 

Ya n 


(44) 


Rearrange equation (44) to combine like terms, recognizing that x q (t)P q B mq is a scalar and may be 
moved appropriately within the expression. 

Vqit) — x q {t) ^ A mq P q + P q A m ^ x q {t) + 2 ® q {t^x q (jY)P q B mq x q {t) 

25 q (t)5 q (t) 


+ 2 d q {t)x T q {t)P q B m + 2® q (t)r g ® q (t) + 


^ (45) 


The Lyapunov stability criteria of V q (t) < 0 is partially satisfied by equation (45) if the matrix P q is 
computed according to the Lyapunov equation A yn P q + P q A m = — Q q , where Q„is positive definite 
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matrix of tunable design parameters. The Lyapunov stability proof is completed by defining the following 
adaptive parameter update laws for substitution into equation (45). 



-®o(t) = - 


Ye, 


91 


0 

Ye q 2 . 


x T q (t)P q B mq x q {t) 



@q (O) — Gq (0 Y<jq X q (tyPqBmq 


(46) 

(47) 


It should be noted that the assumption that the adaptive parameter rates of change are equal to the 
corresponding parameterization errors derivatives in equations (46) and (47) does not hold if the 
uncertainties are not constant or slowly changing as compared to the convergence rate of the adaptive 
parameter estimates. 


Roll Axis MRAC 

Roll axis tracking error is computed by subtracting the aircraft response from the desired dynamics of 
the reference model. 

x p it) = p(t) = Pm(0 - P(0 (48) 

Differentiate equation (48) and substitute equations (22), (25) and (35). 

P(t) = [-m p ]p m (t) + [l]r p (t) - (-m p - 0 p (t)) p(t) - [1] (r p (t) - d p (t)) (49) 

Rearrange equation (49) into the following expression for the roll error dynamics. 

p(t) = A m p P(t) + B mp e v (t)v(t) + B mp d v it) (50) 

Define the following Lyapunov function where P p , yg p and y a>) are positive non-zero scalars. 


Vp(t ) = V 2 (t)P v + 


0p(O <w) 


Ye* 


+ ■ 


Ya„ 


(51) 


Differentiate equation (51). 


Vp(t) = 2p(t)P p p(t) + 


2 dp(t)P P (t) 2a P (t)a P (t) 


Ye„ 


■ + ■ 


Yar, 


(52) 


Substitute equation (50) into equation (52). 


V p (t) = 2 p 2 (t)P p A mp + 2 p(t)P p B mp 6 p (t)p(t) + 2 p(t)P p B mp d p (t) + 


2 9 P (t)B P (t) 
Ye n 


+ 


25 P (t)5 P (t) 


(53) 
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Apply the scalar Lyapunov relationship for the roll axis, 2P p A vlp = — Q p where Q p is a positive, non- 
zero scalar. Define the following adaptive parameter update laws for the roll axis. 

Spit) = - Spit)') = -S p it) = -Ye p vit)P p Bm p vit) (54) 

Spit) = (s p ~ o p it ) ) = Spit) = -Yc p Pit)PpB mp (55) 

The assumption regarding constant or slowly-changing uncertainties described in the pitch axis 
discussion also applies in the roll axis. 

MRAC Controller Implementation Details 

Before describing each of the different adaptive controllers, it is important to discuss several 
implementation details that are common across all three designs. These features address performance and 
robustness problems discovered in the piloted simulation during the process of selecting the tunable 
parameters p and y in equations (46), (47), (54) and (55). In essence they represent the necessary bridge 
between MRAC theory and practical application. 

Addressing Bias in the Pitch Axis 

During the initial implementation process, the presence of quasi-steady, non-zero signals during 
extended pitch maneuvers such as wind-up turns tended to prevent the adaptive parameters from 
converging to their ideal values. Improved adaptation was achieved by minimizing the influence of 
certain biased signals or by removing the biases directly. 

During constant pitch rate maneuvers, the input J qit) grows unboundedly and can quickly begin to 
dominate pitch axis adaptation, producing poor adaptation characteristics. One common implementation 
feature between all three MRAC designs is that the influences of the input J q(t) and its associated 
adaptive parameter 9 ql it) are trivialized. The marginalization of these components, accomplished via the 

and P q matrices, effectively reduces the number of adaptive parameters in the pitch axis to one and 
similarly streamlines the input plane to consist of pitch rate feedback only. 

The learning rate Ye ql for the 6 ql (t) adaptive parameter is set much smaller, at least three orders of 
magnitude, than the learning rate Ye q2 for the 9 q2 it) parameter. Similarly, the gain p q 2 for the J qit) 
input is designed to be much smaller, by at least two orders of magnitude, than the gain p q 2 for the qit) 
input. These parameters were not set identically to zero to avoid violating the requirement of positive 
definiteness on and P q . 

Removing the influence of 9 ql it) and J qit) improved the controllers’ adaptation characteristics in 
constant pitch rate maneuvers. However, there still remained a tendency for 9 q2 it) to over-adapt during 
periods of quasi-steady, non-zero pitch rate. The reason for this becomes apparent by multiplying out the 
terms in equation (46) for 9 q2 (t) under the assumption that p q 2 ~ 0 to yield the expression in equation 
(56). 


S q 2 it) = Ye q 2 Pq 2 q(t)qit) 


(56) 
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It was observed, for example, that in a windup turn the achieved pitch rate was generally somewhat 
less than the reference model command, causing both q(t) and q(t) to be consistently greater than zero. 
By definition, Ye q2 and p 22 are also positive non-zero, resulting in steady positive growth of the adaptive 

parameter d q2 (t)- An examination of the aircraft dynamics in equation (32) reveals that positive increases 
in 8 q 2 (f) correlate to reductions in closed- loop damping. This is consistent with the behavior observed in 
the piloted simulation, where the aircraft would lose damping during windup turns, eventually becoming 
unstable in pitch. It should be noted that this phenomenon was generally only observed in the two 
controller designs that did not include an estimation of the d q (t) term. From equation (17) it can be seen 
that d q {t) compensates for uncertainty in the loop gain, which would drive the error q to zero and avoid 
over-adaptation. 

To address over adaptation of the d q2 (t) during constant pitch rate maneuvers, a high-pass filter was 
applied to the terms q(t) and q(t) in equation (56). The same high-pass filter was applied to the pitch rate 
feedback term q(t) in the adaptive augmentation command of equation (30). 

Addressing Bias in the Roll Axis 

During extended steady-heading sideslip maneuvers in the piloted simulation, frequent over- 
adaptation of the roll axis adaptive parameter 0 p (t) occurred, resulting in uncommanded roll excursions. 
The root cause was very similar to the bias issue with 8 q2 (t) described above, although the roll-axis issue 
was discovered first. Essentially, the steady non-zero roll stick input required to accomplish the sideslip 
maneuver produced a non-zero reference model command. However, in this maneuver the rudder pedals 
are used to prevent the airplane from rolling and to achieve the desired sideslip. This discrepancy between 
roll command and feedback produced a large non-zero roll error, which tended to drive the value of 0 p (t) 
to extreme values if the roll rate was not kept precisely zero and ultimately a large roll acceleration 
command resulted. 

Following the discovery of this anomaly, a high-pass filter for the roll axis was discussed, but 
eliminated from consideration due to uncertainty over how it might impact other aspects of roll-axis 
performance. In keeping with the philosophy of a minimum complexity controller, the seemingly simpler 
approach was selected of fading the roll axis tracking error to zero as a function of rudder pedal 
displacement. A gain on the error was linearly reduced from one to zero over the first 50 percent of the 
available rudder pedal displacement, and held at zero for displacements larger than 50 percent. This 
solution effectively prevented further uncommanded roll excursions during steady-heading sideslips. 

Later in the tuning process when high-pass filters were being added to the pitch axis to address a 
similar problem, high-pass filters were again considered for the roll axis. However, because the existing 
rudder-pedal attenuation gain corrected the problems with steady-heading sideslips and no other issues 
were found in the roll axis during parameter tuning, high-pass filtering was not implemented in the roll 
axis. Ultimately, several events during flight research later pointed to high-pass filtering as a likely better 
solution than the one implemented. 

1. It was observed during 2g air-to-air tracking that some of the test pilots used rudder pedals more 
extensively than anticipated, causing the rudder pedal attenuation gain to adversely impact roll- 
axis adaptation during these maneuvers. 

2. During simulation training of a NASA guest (non-program) pilot, uncommanded rolls 
occurred repeatedly during windup turns with a simulated failed stabilator. The cause was 
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attributed to the unusually smooth and low-gain technique of this particular pilot, 
producing a bias scenario similar to the one described previously for d q2 (t). 

3. A roll-axis pilot-in-the-loop oscillation occurred during a formation tracking maneuver in 
which the wingtip vortex of the lead airplane produced a roll bias on the test aircraft (ref. 13). 

Error Signal Time Correlation 

In the initial implementation, system transport delays and structural filter phase losses on measured 
feedback parameters produced systemic tracking error in both axes. The calculations for tracking error are 
given by equations (37) and (48) for pitch and roll respectively. Even under ideal aircraft responses that 
matched the desired reference model dynamics, tracking error persisted due to phase differences between 
the command and feedback. This persistent error tended to overdrive the adaptive gains, lower 
performance, and reduce robustness to time delays. 

Multi- frame first-order holds were placed on q m (t) and p m (t) to better align those signals with their 
corresponding feedback signals. Each signal was delayed by 50 milliseconds, an amount that was 
determined empirically in the piloted simulation during the adaptive parameter tuning process. 

Miscellaneous Features 

Additional features that were integrated into the control system are as follows. Integration limits were 
applied to the adaptive parameters to prevent excessive control commands in the event of over-adaptation. 
Limits were set slightly higher than the largest parameter values that were observed during piloted 
simulation evaluation of simulated failure/damage scenarios. 

Some control over the adaptive augmentation was given to the pilot, including the ability to turn the 
adaptive controller on and off, and to freeze the adaptive parameters through the use of a button on the 
control stick. These features fulfilled two purposes. First, the results of flight experimentation were 
enhanced by the ability to conduct back-to-back comparisons of a given configuration with and without 
adaptation. Freezing the weights allowed the pilot to conduct identification maneuvers, such as frequency 
sweeps with the control stick, without altering the state of the adaptive controller. The second advantage 
of these features was to study pilot interaction with the adaptive control system. Some questions of 
interest include evaluation of pilot-initiated adaptive control versus automatic initiation of adaptation, and 
whether it is advisable to freeze the adaptive controller once adequate tracking has been restored. 


MRAC Designs of Varying Complexity 

Three MRAC controllers were implemented and tested to explore the relationships between adaptive 
controller complexity and performance, robustness, and handling qualities. The three controllers were 
built upon each other by adding levels of complexity rather than implementing three entirely independent 
designs. In this way, the positive and negative effects of the additional complexity can be studied. 

Free design parameters were tuned in a piloted simulation for acceptable response when no failures 
were present as well as across a wide variety of simulated failures and damage scenarios. Although there 
were many parameters common to all three controllers, these were tuned differently for each controller as 
the additional complexity components tended to significantly affect performance, and the parameter 
values were adjusted accordingly. Aggressive pilot inputs were used during tuning to stress the system, 
and parameters were adjusted to achieve the fastest adaptation possible without introducing undesirable 
side effects such as over- adaptation and actuator rate limiting. Additional metrics used during the tuning 
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process included the integral of the tracking error, empirically-determined gain and time delay margins, 
and pilot comments. 

The adaptive parameter update laws given in equations (46), (47), (54) and (55) represent the basic 
starting point in the implementation of the three adaptive controllers for the experiment. Differences 
between the three adaptive controllers are described in the following sections. 

Simple MRAC (sMRAC) 

Two of the three controllers have essentially a single adaptive parameter in each axis, where 9 ql (t) is 
trivialized in the pitch axis as described earlier, and y aq and y ap are set to zero to eliminate the adaptive 
parameters o q (t) and cr p (t). The first of these designs, sMRAC, makes use of the simple adaptive 
parameter update laws as they are described in equations (46) and (54). 

As an example, the pitch axis adaptive update law in equation (46) simplifies to equation (57) under 
the assumption that the off-diagonal terms of the tunable design matrix Q q are zero. See Appendix A, 
Calculation of the P q Matrix for solutions to the Lyapunov equation. For all three controllers, Q q was 
chosen to be diagonal, although there is no requirement for it to be so. The gains q q l and q q 2 are the 
upper-left and lower right elements, respectively, of Q q . These gains were set as q q l =0.01 and q q 2 = 1 
for all three controllers so that the influence of q(t) is approximately three orders of magnitude greater 
than that of J q(t). The learning rate for sMRAC was selected as Ye q2 = 1- 

Mo = \re q2 (J^j / <KO 

(57) 


MRAC with Optimal Control Modification and Normalization (onMRAC) 

The onMRAC controller incorporates an optimal control modification term (ref. 14) and 
normalization into the update laws, described by equations (58) and (59). 


Mo 

9 q 2 (0. 



1 + x T q {t)N e x q (t) 


X q (J-^PqBm.q X q (0 


v e, 


0 

qi 

0 v ei 


q 2 


Xq(t)x T q (t) 


9ql(t) 
9 q 2 (0 


fj T p A - 1 
D mq r q- n m q 


Ye p 

+ p 2 (t)Nn 


(p(.t)P p B mp p(t) - v gp p 2 (t)9 p (t)B^ p P p A 



(58) 

(59) 


Optimal control modification (OCM) is an update law modification term that helps to alleviate over- 
adaptation and dampen oscillations in the adaptive parameters. In equations (58) and (59), the first term 
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within the parentheses is the standard update law and the second term is the optimal control modification. 
Taking the pitch axis as an example, an examination of the elements of the OCM term reveals that 
Bm q PqAm q B mq is a scalar with a value of ~'-q q l , where q l q l is the upper-left element of the positive- 
definite diagonal matrix Q q . The tunable OCM gain Vg was set to zero since the adaptive parameter 8 ql 
was essentially zeroed out. The OCM expression for the 0 q2 (t) update law becomes 
+^<Jq 1 v o q2 ®q 2 (t)q 2 (t) under the assumption that 6 ql (t) = 0. In the final design, q q x = 0.01 and 
v Q q 2 = —200 so that the OCM term was simply — 0q 2 (tV(O- 

Normalization suppresses adaptation during large dynamic maneuvers through attenuation of the 
learning rate by the inverse of the weighted square of the feedback parameters. Squaring the input vector 
ensures that it is always positive, and weighting allows the designer to control the relative influence of 
each feedback term on the normalizing behavior. In the pitch axis onMRAC update law, the relative 
influence of the J q(t) term was kept very low. The normalization terms are also biased by a constant of 
one to prevent a divide-by-zero when the feedback vectors are zero. Inclusion of OCM and normalization 
allowed the learning rate Ye , to be increased from 1 to 50, enabling faster adaptation. 


MRAC plus Adaptation for Disturbances (onMRAC+) 

The third and most complex of the three controllers maintained the same update laws and tuning 
parameters as onMRAC for 9 ql (t), d q2 (t) and 0 p (t) while adding update laws for d q (t) and <7 p (t), 
given by equations (60) and (61). 


4(0 = 


Ya n 


i+xj(o N-xtar"' q 


6 v (t) = 


Y° v 

l + p 2 (t)N a 


( P(t)P t 


x T q {t)P q B r 

pBrrip d" v Cp^p^rn p Pp^m 


Ip ^TTlp ^ 


(60) 

(61) 


Normalization was found during the design process to improve the adaptation characteristics of both 
<T q (t) and <7 p (t ) . Without normalization, high-rate pilot inputs produced excessively large transient values 
of both terms. Tuning of the learning rates y ff and Ya p was insufficient to eliminate these transients 
without simultaneously making the adaptive parameters ineffective. Normalization allowed sufficiently 
fast adaptation without excessive transients. 


Note that an OCM term is present in the update law for <r p (t), but not for a q (t ) . In the initial design, 
it was not clear whether OCM was necessary in the calculation of the disturbance adaptive parameters. In 
the interest of keeping the controller as simple as possible, OCM was not included in either. During the 
first research flight, a persistent 1 Hz, ±0.5 deg/s oscillation was present in roll rate and was also observed 
in the value of 6 p (t)- Implementation of OCM in that parameter’s update law eliminated the oscillation 
on all of the remaining flights. Because a similar oscillation was not observed in d q (t), no OCM term was 
added for that parameter. During handling qualities maneuvers at the end of the flight phase of the 
experiment, interactions between the pilot and the pitch axis onMRAC± controller were observed that 
likely adversely affected the pilot’s rating of the system (refs. 13, 15). Subsequent simulation studies 
indicated that the addition of an OCM term to the a q (f ) update law would eliminate these interactions. 
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Summary 

Three model reference adaptive controllers, each representing an incremental increase in complexity, 
were designed and implemented as augmentation systems to a nonlinear dynamic inversion controller on 
a NASA F-18 test aircraft. The controllers were part of an experiment intended to evaluate the effect of 
adaptive controller complexity on performance, robustness, and pilot handling qualities in the event of 
aircraft failures or damage. The simplest controller is derived from basic MRAC theory and contains 
essentially a single adaptive parameter each in the pitch and roll axes. The more complex controllers 
expand upon the update laws and add a second adaptive parameter in each axis. Special design 
modifications are described to address biased measurements and other considerations required for 
implementation on a full-scale, piloted aircraft. Flight test results for the controllers are described in 
references 13 and 15. 
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Appendix A 


Calculation of the P q Matrix 

The Lyapunov equation is given in equation (Al). 

AniqPq + Pq^m q ~ ~Qq (Al) 

For a second-order system in the form of equation (12) and a diagonal Q matrix, the Lyapunov 
equation is written as follows. 


o -ol 2 1 K 1 p$ 2 ] , [p , 11 pI 2 1 r o 


1 -2(qUq\ [Pq 1 pf\ [Pq 1 Pq 2 J L 


o 

0 


Expanding equation (A2) gives four equations with the four u nk nowns pV } n . 


ito 2 + p, 21 ) = -<# 


(A3 a) 


Pq ~ °>qPq ~ 2 Sq*>qPq = 0 


(A3b) 


Pq 1 ~ OJ qPq 2 ~ 2 (qtaqPj 1 = 0 


(A3c) 


Pq 2 + Pq 1 ~ 4(qUqPq 2 = 


(A3d) 


It is clear from equations (A3b) and (A3c) that p q 2 = Pq 1 , making the P q matrix symmetric. From 
equation (A3 a), the off-diagonal terms can be determined. 


12 21 11 
Pq = Pq = qq 


Substitution of equation ( A4) into equation ( A3d) gives the expression for p 2z 


Pq 2 = qV 


w qj 


Finally, equations (A4) and (A5) can be inserted into equation (A3b) or (A3c) to find pi 1 


11 11 
Pq = qq 


1+4 a 


y 22 / M q 
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